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ABSTRACT 



Reports of all published factor analyses of student ratings of college 

faculty were analyzed to determine what common factors emerge and to identify 

items likely to be useful in discriminating teachers along basic dimensions of 

difference. A 59“ item fc.’m was administered to students of 18 instructors 

both at the beginning and end of a semester course. Results were analyzed 

both by factor analysis and multiple discriminant analyses. The dimensions 

emerging were compared with those reported earlier by Isaacson, et al. (1964). 

The Isaacson, et al. data were reanalyzed by the methods used in the present 

study. The following dimensions seemed common to the two studies: 

structure 

skill 

rapport 

Structure and skill also appeared in pretest data collected during the 
first week of cl~s. 

The differences between the results of multiple discriminant analysis and 
factor analysis point to differences between student stereotypes of teacher 
behavior and differences between teachers. Both analyses provide useful in- 
formation, but for uses in which the primary concern is to compare one teacher 
with another, the dimensions derived by multiple discriminant analyses seem 
likely to be more useful. 
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INTRODUCTION 




Effective teaching is increasingly a major topic in discussions of higher 
education. Students, administrators, and perhaps even faculty would like to 
have effective teaching encouraged and rewarded. But to do this some system 
of evaluation must be found. Since the purpose of teaching is student learn- 
ing, students are an obvious possible source of information. Typically, each 
college’s student or faculty committee devises a rating form based on its own 
impressions of the qualities most important for their purposes. Forms vary in 
length from one or two items to fifty or more. Given a limited amount of time 
for administration, one would like to get the most possible information from 
the fewest possible items. If many items are measuring the same quality, one 
would prefer to substitute items measuring other characteristics differenti- 
ating teachers. 

The typical method of solving this problem is factor analysis. But as 
Norman ( 1967 ), Gollob ( 1968 ), and others have pointed out, the results of 
factor analysis are muddied by confounding a number of sources of variance: 
items, raters, ratees, and interactions. Our previous research (Isaacson, 
McKeachie, et al. , 1964; McKeachie, Lin, and Mann, 1971) bas identified six 
factors that seem relatively stable across teachers and courses. While we 
believe that these factors make theoretical as well as empirical sense, we 
recognize that the criticisms of conventional factor analysis are applicable. 

The purpose of the present study was to attempt to clean up the factor 
analytic studies by determining what dimensions actually differentiate teachers 
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In other publications (McKeachie, 1969) we have suggested that the type 
of scale used to assess student opinion about teaching should be determined by 
the purposes of the scale. Almost all of these purposes, however, involve 
discrimination among teachers. For example, scales designed to assist in ad- 
ministrative decisions such as salary increases for good teachers, as well as 
those designed to assist in choosing which courses to elect, require effective 
differentiation of one teacher from another. Even scales designed primarily 
as feedback to a teacher for his own self-improvement might well involve items 
which inform the teacher about how he differs from other teachers. Thus the 
use of multiple discriminant analysis to identify dimensions of differences 
between teachers should be preferable to factor analysis. 
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PROCETURES 



CONSTRUCTION OF A RATING FORM 

All publisher factor analytic studies of student ratings of college 
teachers were reviewed. From these studies thirty-nine items were chosen 
which had had high loadings on factors identified in the previous studies. 
These items were administered both at the first meeting (Pretest) of the 
course "Introduction to Psychology as a Natural Science" and during the last 
week of the course (Posttest). (The forms used are included in Appendix A.) 

SAMPLE OF TEACHERS 

The sample of teachers consists of 13 male and 3 female instructors 
(teaching fellows) in an introductory psychology course. Half of these teach- 
ers taught one section and another half taught two sections. Because our in- 
terest focused on the differences between teachers, each teacher was treated 
as a unit. Each teacher also rated himself on the same rating form used by 
the students during the term. 

SAMPLE OF STUDENTS 

Three hundred and twenty-one (321) students completed the rating form in 
the pretest and 336 students completed the rating form in the posttest. The 
number of students varied from 10 to 46 for those 18 teachers in the posttest. 
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METHODS OF DATA ANALYSIS 



Multiple Discriminant Analysis 

Multiple discriminant analysis may be considered as ,: an extension of 
simple-classification analysis of variance to include simultaneously a group 
of dependent variables" (Veldman, 1967). The main purpose of this technique 
is to find a set of linear combination of variables (factors) which can, 
better than any other linear combination, discriminate between groups. In 
other worr.s , this technique attempts to find a set of discriminant functions. 
The first function maximizes the ratio of the among-groups cross products of 
deviation matrix (A matrix) to the pooled within-group deviation scores cross 
product matrix (W matrix). The second discriminant function maximizes the 
ratio of the residual A matrix to the residual W matrix after the effect of 
the first function has been removed, and so forth (Tiederaan, 1951; Rulon, 

1951; Bryan, 1951; Tatsuoka a..d Tiedeman, 195** > 1965; Cooley and Lohnec, 1962; 
and Nunnally, 196?). "...the factoring of the W ^ A matrix may be constructed 

as the partitioning of the discriminating power of the set of dependent vari- 
ables into independent components, which may perhaps lead to or support hy- 
potheses about underlying sources of the vari it ion among the groups" (Veldman, 
1967). 

The present study utilized a computer program called DSCRIM (Veldman, 
1967) to get k discriminant dimensions (K = G-l, where G is number of groups). 
A mxk correlation matrix (m: number of variables) between the original vari- 

ables and the discriminant functions variables was generated. "The correla- 
tion coefficients may be interpreted in much tne same way as factor loadings 
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to describe the discriminant dimensions in terms of the name of the original 
vuriebLes" (Veldmnn, lyi’Y). 

However, not all the k discriminant functions may be significant. Rao 
(195>2) has proposed a chi-square test of significance for each discriminant 
function. This test was applied. The significant dimensions remaining after 
use of the chi-square test were then subjected to a varimax rotation program 
(Kaiser, 19^8) to obtain a simple structure. The application of the "Wrigley 
Kiel criterion" in the rotation program (Wrigley has suggested that 3 be the 
minimum number of variables for defining a factor) further reduced the number 
of dimensions remaining for a meaningful psychological interpretation. 
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Three sets of results are presented. 



MULTIPLE DISCRIMINANT ANALYSIS OF POSTTEST STUDENT RATINGS (1971 DATA) 

The multiple discriminant analysis of the posttest student ratings of 18 
teachers first yielded 17 discriminant dimensions. Rao's chi-square test of 
significance showed that only the first 10 dimensions were significant at the 
yfo level or less. The 59 x 10 factor matrix was then subjected to a varimax 
rotation program and only 5 factors emerged after the rotation. Table I lists 
the items with loadings of .50 or above on each of these five discriminant di- 
mensions. 

The content of items loaded on each dimension suggest that the first di- 
mension is clearly a "Teaching Skills" factor with emphasis on teacher's abil- 
ities to stimulate student's intellectual curiosity, to increase the interest 
of class member, to present his teaching materials, etc. The second dimension 
is "Structure. " The third is a "Group- Interaction" factor with emphasis on 
teacher-student interaction in the classroom. The fourth is a "Feedback" 
factor with emphasis on the discussion of test material after examination. 

The fifth dimension seems to be an "Achievement Standards" factor with moder- 
ate loadings on "teacher's emphasis on grades" and "high quality work" items. 
These five dimensions seem quite meaningful in differentiating teachers. 

Univariate F-Tests results showed that only the following three items of 
the thirty-nine used in the present study failed to show significant 



TABLE i 



VARIMAX ROTATED FACTORS OF MULTIPLE DISCRIMINANT 
ANALYSIS FACTORS OF STUDENT RATINGS 

(Psychology 170, Winter, 1971, 18 T.F. ) 



Factor I - Skill 

.66 How would you rate your instructor in general (all-around) teaching 
ability? 

.37 He stimulated the intellectual curiosity of his students. 

.56 He increased the interest of class members in his class. 

.34 In his class students gained a great deal of knowledge about this sub- 

ject matter. 

. 31 The content of examinations was appropriate. 

.46 He listened attentively to what class members had to say. 

.46 He explained clearly and his explanations were to the point. 

.46 He was friendly. 

.45 The instructor was skillful in observing student reactions. 

.45 In his class students learned how to think more clearly about the area 
of this course. 

.44 He appeared sensitive to students' feelings and problems. 

.45 He was tolerant of student opinions. 

.42 In his class, I felt free to ask questions, to express my opinions and 
disagree. 

.40 The instructor put his material across in an interesting way. 

•37 How would you rate the overall value of this course? 

.36 His course was well organized. 

.34 The students frequently volunteered their own opinions. 

.33 The students in the class were friendly. 



Factor II - Structure (Formal Authority) 

.73 His course was well organized. 

.63 He followed an outline closely. 

.39 He had everything going according to schedule. 

.30 He explained clearly and his explanations were to the point. 

.39 He decided in detail what should be done and how it should be done. 

.32 In his class students learned how to think more clearly about the area 

of this course. 

-.37 The instructor assigned very difficult readings. 
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Factor III - Group Interaction 

.67 The students frequently volunteered their own opinions. 

.64 Students argued with one another or with the instructor, not neces- 
sarily with hostility. 

.43 The students in the class were friendly. 

.33 He was tolerant of student opinions. 

.33 The instructor was skillful in observing student reactions. 

.32 He listened attentively to what class members had to say. 

.31 In his class, I felt free to ask questions, to express my opinions and 
disagree. 

Factor IV - Feedback 

.67 He discussed test material after each quiz or exam. 

.40 The instructor assigned very difficult readings. 

-.33 He criticized poor work. 

Factor V - Achievement Standards 

.42 He continually emphasized grades. 

•37 He kept students well informed of their progress. 

.31 The students in the class were friendly. 

.30 He stressed high quality work. 
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differences among the 18 teachers. 



"He maintained definite standards of student performance. 
"He responded to hostility constructively. " 

"He asked more than students could get done. " 



COMPARISON BETWEEN 1971 AND 1961 DATA ON 24 COMMON ITEMS 
Student Ratings of Male Teachers 

Out of 59 items used in the present study, 24 items had been selected 
from a rating form used in 1961 in a previous study (Isaacson, et al. , 1964). 
In the Isaacson, et al. study, the factors identified were based on student 
rating data from a sample of students across 16 teachers. The present study 
reanalyzed the 1961 data by using the multiple discriminant analysis technique 
for student ratings on 15 male teachers (615 students) and analyzed the same 
items in the 1971 data for student ratings on 13 male teachers (264 students). 
The purpose was to provide some comparative data on the dimensions identified 
from two different samples of teachers and students. 

Following the same procedures as used for the analysis of the 39 items, 
we found four dimensions for the 24 items. Tables II and III present the 
items and loadings on the 4 factors identified in the 1971 and in the 1961 
data, respectively. A list of factors identified in both years is summarized 
as follows : 



Factor 



1971 



1961 



1 

2 

5 

4 



Teaching Skills 
Structure 
Group-Inter act ion 
Overload 



Teaching Skills 



Overload 

Structure 

Feedback 



12 

9 



TABLE II 



VARIMAX ROTATED FACTORS OF MULTIPLE DISCRIMINANT 
ANALYSIS FACTORS OF STUDENT RATINGS 

(24 Items, 15 Male T.F. , 264 Students, Psychology 170, Winter, l$7l) 



Factor I - Skill 

•78 How would you rate your instructor in general teaching ability? 

.61 He explained clearly and his explanations were to the point. 

,6l He stimulated the intellectual curiosity of his students. 

.^7 He increased the interest of class members in his class. 

.52 The instructor put his material across in an interesting way. 

.^l The instructor was skillful in observing student reactions. 

.4^ He listened attentively to what class members had to say. 

.44 How would you rate the overall value of this course? 

.43 The students frequently volunteered their own opinions. 

.41 In his class, I felt free to ask questions, to express my opinions and 
disagree. 

.40 He was friendly. 

.40 He had everything going according to schedule. 

.36 He told students when they had done a particularly good job. 

Factor II - Structure 

•37 He decided in detail what should be done and how it should be done. 

.34 He follow an outline closely. 

.31 He continually emphasized grades. 

.30 He had everything going according to schedule. 

.36 He explained clearly and his explanations were to the point. 

.31 He maintained definite standard of student performance. 

-.41 He was permissive and flexible. 



Factor III - Group Interaction 

.64 Students argued with one another or with the instructor, not neces- 
sarily with hostility. 

.32 The students frequently volunteered their own opinions. 

.40 The instructor complimented students on their work in front of others. 

•37 The students in the class were friendly. 

.30 He was permissive and flexible. 
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TABLE II (Concluded) 



Factor IV - Overload (Difficulty) 

.77 The instructor assigned very difficult reading. 

.41 He was friendly. 

•37 The students in the class were friendly. 

•35 He continually emphasized grades. 

-.30 He followed an outline closely. 
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TABLE III 



VARIMAX ROTATED FACTORS OF MULTIPLE DISCRIMINANT 
ANALYSIS FACTORS OF STUDENT RATINGS 

(24 Items, 13 Male T.F., 613 Students, Spring, 1961) 

Factor I - Skill 

.74 He put his material across in an interesting way. 

.74 How would you rate your instructor in general teaching ability? 

.67 He explained clearly and his explanations were to the point. 

.62 The instructor was skillful in observing student reactions. 

.60 He stimulated the intellectual curiosity of his students. 

.46 He tried to increase the interest of class members in his subject. 
.59 He maintained definite standards of student performance. 

.33 The students frequently volunteered their own opinions. 

.32 He complimented a student on his work in front of others. 



Factor II - Overload 

•78 The instructor assigned very difficult reading. 
.34 He asked for more than students could get done. 



Factor III - Structure 

•80 He folic ^d an outline closely. 

.72 He had everything going according to schedule. 



Factor IV - Feedback 

.39 He told students when they had done a particularly good job. 

.48 He put his material across in an interesting way. 

.41 He complimented a student on his work in front of others. 

.40 He tried to increase the interest of class members in his subject. 
.34 He listened attentively to what class members had to say. 

.32 He was friendly. 

-.40 He continually emphasized grades. 
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Although three factors in both studies have the same labels, the constit- 
uents of each factor are not quite the same. It is interesting that these 
five factors appear to be comparable to five of the factors identified in the 
earlier study (Isaacson, et al. , 1964). 

FACTOR ANALYSIS OF 18 TEACHERS SELF RATINGS OF TEACHING BEHAVIOR 

During the term, the participating teachers also rated themselves on the 
same rating form to describe their teaching behavior. A factor analysis of 
these ratings provides some data on the dimensions or characteristics of their 
teaching behavior as perceived by the teachers themselves. Five vanmax ro- 
tated factors were obtained from a sample of 18 teachers. Because the sample 
size is small for a factor analytic study, the factors identified will there- 
fore provide some suggestions only. 

The first factor is a "Teaching Skills" factor with emphasis on the abil- 
ities to stimulate intellectual curiosity, to explain clearly, to increase the 
interest of class members, etc. on the one end and "feedback" on the other end 
of the dimension. The second factor is related to the teacher's function as 
an authority in evaluation and examination. The emphasis is on the fairness 
and appropriateness of these functions. The third factor is a bipolar factor 
with "feedback" on one end and "structure" or "organization" on the other. 

The fourth factor is also a bipolar factor with "overload" on one end and 
"rapport with students" on the other. The fifth factor seems related to 
"achievement standards" with the emphasis on teacher's expectation and high 
quality of student performance. 
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TABLE IV 



FACTOR ANALYSIS OF 18 TEACHING FELLOW SELF-RATINGS 
(Psychology 170, Winter, 1971) 



Factor I - Skill vs. Feedback 

.79 He explained clearly and his explanations were to the point. 

•78 He stimulated the intellectual curiosity of his students. 

•75 ! n bis class students learnea how to think more clearly about the area 
of this course. 

.70 In his class, students learned how to read materials in this area more 
effectively. 

.69 How would you rate your instructor in general (all-around) teaching 
ability? 

.68 The students frequently volunteered their own opinions. 

.65 He increased the interest of class members in his class. 

•58 He was tolerant of student opinions. 

• 32 The instructor was skillful in observing student reactions. 

.46 He helped students learn from their mistakes. 

.44 The instructor put his material across in an interesting way. 

•37 He responded to hostility constructively. 

.31 He continually emphasized grades. 

-.39 He followed an outline closely. 

-.48 The instructor complimented students on their work in front of others. 
-.48 He criticized poor work. 

-.35 He kept students well informed of their progress. 



Factor II - Evaluation of Achievement 

.84 He was fair in grading and evaluation. 

.75 The content of examinations was appropriate. 

.69 How would you rate the overall value of this course? 

.63 In his class students gained a great deal of knowledge about this 

subject matter. 

.51 The instructor put his material across in an interesting way. 

.43 Students argued with one another or with the instructor, not neces- 
sarily with hostility. 

.41 His course was well organized. 

.4l How would you rate your instructor in general (all-around) teaching 
ability? 

•35 He increased the interest of class members in his class. 

. 3L He was friendly. 

•33 l n bis class, I felt free to ask questions, to express my opinions 
and disagree. 

.30 He stressed high quality work. 
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TABLE IV (Continued) 



Factor 

.78 

•74 

.69 

.61 

.56 

•51 

.44 

.41 

.51 

-.50 

-.50 

-.56 

-.41 

-.46 

-.60 



Factor 

.80 

.50 

.47 

.45 

.44 

.40 

.56 

.54 

.34 

-.43 

-.52 

-.65 

-.66 



III - Feedback vs. Structure 

He discussed test material after each quiz or exam. 

He let students know when they were wrong. 

He helped students learn from their mistakes. 

He was permissive and flexible. 

He listened attentively to what class members had to say. 

The content of examinations was appropriate. 

He was tolerant of student opinions. 

The instructor was skillful in observing student reactions. 

In his class students learned how to think more clearly about the 
area of this course. 

He maintained definite standards of student performance. 

The instructor put his material across in an interesting way. 

His course was well organized . 

He followed an outline closely. 

He continually emphasized grades. 

He decided in detail what should be done and how it should be done 
He had everything going according to schedule. 



IV - Overload vs. Rapport with Students 

The instructor assigned very difficult readings. 

The instructor put his material across in an interesting way. 
Students argued with one another or with the instructor, not neces 
sarily with hostility. 

He was friendly. 

He continually emphasized grades. 

He let students know when they were wrong. 

He criticized poor work. 

He asked more than students could get done. 

He helped students learn from their mistakes. 

In his class, students learned how read materials in this area 
more effectively. 

He responded to hostility constructively. 

His course was well organized. 

He appeared sensitive to students' feelings and problems. 
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TABLE IV (Concluded) 



Factor V - Achievement Standards 

•74 He told students when they had done a particularly good job. 

•73 He maintained definite standards of student performance. 

•71 The students in the class were friendly. 

.70 He made it clear to students about the purpose and objective of his 
course , and his expectation of students. 

.66 He continually emphasized grades. 

•62 In his class, I felt free to ask questions, to express my opinions 
and disagree. 

.58 The instructor complimented students on their work in front of others. 

•54 In his class students gained a great deal of knowledge about this 
subject matter. 

• 33 He stressed high quality work. 

.49 He decided in detail what should be done and how it should be done. 

.48 He asked more than students could get done. 

.47 He followed an outline closely. 

.41 Students argued with one smother or with the instructor, not neces- 
sarily with hostility. 
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These five dimensions of teacher’s perceived teaching behavior suggest 



that teachers perceive their functions to be in the domain of: 

1. Tho teacher's abilities to stimulate intellectual curiosity, to 
maintain interest of class members, to present teaching material 
adequately, etc. This also includes the abilities to organize 
the class activities and the teaching materials as well. 

2. The teacher as an authority to evaluate students. Appropriate- 
ness and fairness are Important. 

5 . The teacher’s ability to set clear and attainable goals and high 
standards of performance for students amid to provide appropriate 
feedback. 

4. The teacher's sensitivity to student's problems and needs. 

These functions of teachers as perceived by the teachers themselves seem 
to correspond rather well to the characteristics of teaching behavior differ- 
entiating teachers as perceived by the students. 
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DISCUSSION 



Aside from the aesthetic satisfaction derived from having eliminated the 
mixed sources of variance for which factor analysis has been criticized, did 
the use of r ultiple discriminant functions really contribute anything to our 
: understanding of teaching? Our answer at this point cannot be a resounding 

1 ’yes" since the dimensions identified prove to be generally similar to those 

identified in our earlier factor analytic studies. Probably the chief con- 
tribution is simply that of strengthening our conviction that these dimensions 
are quite fundamental since they have now appeared in yet another sample of 
teachers in a course somewhat different from the courses in which the earlier 
data were collected and with a method of data analysis which is somewhat 
cleaner with respect to our objectives. 

Most encouraging is the finding that for all samples, including the 
teachers themselves, among the highest loading items on "skill” are those 
having to do with stimulating curiosity and increasing student interest. 

These items have to do with goals that are basic if the task of the college 
is to develop life-long learners. It is also reassuring to find that other 
items on this factor include "students gained a great deal of knowledge about 
this subject matter and "students learned how to think more clearly." 

A second satisfying outcome of this study has been the first successes 
in linking our studies of student ratings with the theoretical typology of 
teaching proposed in the final report of our earlier research project 

I (Mo Reach io, W., Mann, R., Milholland, J., et. al. , Research on the Character- 

| 
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istics of Effective Teaching , Final Report Project #05950, Grant fOE-^-lO-OOl, 



August 1968) and developed in Mann, R., et al., The College Classroom , 

New York: Wiley, 1970, The "Structure" dime, ■'ion clearly and consistently 

differentiates teachers both in student and teachers’ own ratings. The items 
marking this factor fit very nicely with our description of the "Teacher as 
Formal Authority." 

The "Group Interaction" dimension unfortunately emerges somewhat less 
consistently, but seems to correspond well to the "Teacher as Facilitator" 
of our typology. 

Some of the other dimensions are puzzling. For example the item, "The 
instructor assigned very difficult reading," which has consistently marked 
an "Overload" or difficulty dimension, is in this analysis on the same dimen- 
sion as "He was friendly" and "He continually emphasized grades." Apparently 
in our sample the taskmaster makes a real effort to win student acceptance. 

While the present study did not unfold unexpected new vistas, it did 
help us to clarify the directions in which we think future research should 
go. We think this research taken with our previous work has made the dimen- 
sions of mathematical space in which student evaluations of teachers lies 
fairly clear and familiar. We now should be on fairly solid ground in moving 
into the area of validating different scales for the different purposes for 
which student ratings are used. 

In our earlier work we suggested that validating ratings of effectiveness 
against measures of mean student achievement of course objectives depended 

upon more differentiated ratings of students’ perceptions of their own 

22 
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learning. We included such items in the present study and have demonstrated 
that teachers are differentiated in student ratings of achievement of these 
goals. We need now to validate these items against the relevant criterion 
measures. 

But validating items against criteria of effectiveness will not neces- 
sarily yield scales maximally useful for the purposes of teacher improvement 
or for the purpose of informing students about teacher characteristics. We 
thus need research not only on which items are most useful in facilitating 
student improvement, but also upon how information from student ratings can 
best be used in a total program of teacher development. This implies the use 
of ratings with different types of feedback mechanisms and perhaps differing 
patterns of data collection. 
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APPENDIX A 

STUDENT OPINION QUESTIONNAIRES 
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Student Opinion Questionnaire 
( Pretest) 

Directions 



This is a research study aimed at the improvement of college teaching. 
The form attached is to be turned in to your psychology section instructor at 
the beginning of the next class period. 

Our previous studies have shown that students can adequately describe 
teaching behavior. Therefore, you are asked to spend a few minutes to help 
us better understand college teaching. 

Descriptions of teaching behavior could be based on (a) your actual 
observation of teacher in the classroom, or (b) your expectation and past 
experience with teachers. Either perception or expectation would enable you 
to have some ideas about teacher's role and his behavior. The purpose of 
this study is to find out what you expect your psychology teacher to be like. 

The questions which follow ask you to describe your section instructor's 
behavior. Except for the last two items, they do not judge whether the 
behavior is desirable or undesirable. Therefore, in no way are the questions 
to be considered as a "test" of your ability to answer the items or of the 
quality of the instructor's behavior. 

Please make no mark in this booklet but record your answers on the 
separate answer sheet. At the top of the answer sheet fill in the blanks for 
sex, date, school, instructor's name (if known), section number, and your ID 
number. The use of this questionnaire is for research purposes only. Your 
instructor will not see it, but we will return to him a statistical summary 
of the results after the semester is over. 

Now you are going to describe your Introductory Psychology ( Psychology 
170) Instructor. Although you may not have had a chance to meet him person- 
ally yet, please describe him as you think he is likely to be. Read each 
item carefully. Think about how frequently the behavior described by the 
item would occur in your class. 
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Student Opinion Questionnaire 



Mark your answer to each item on the separate answer sheet in accordance with 
the following scales: 

a. This almost always will occur. 

b. This often will occur. 

c. This occasionally will occur. 

d. This seldom will occur. 

e. This never will occur. 

1. The students in the class were friendly. 

2. The instructor was skillful in observing student reactions. 

3. The instructor assigned very difficult readings. 

4. The instructor put his material across in an interesting way. 

5. He listened attentively to what class members had to say. 

6. In his class students gained a great deal of knowledge about this subject 
matter. 

7. He told students when they had done a particularly good job. 

8. He decided in detail what should be done and how it should be done. 

9. He explained clearly and his explanations were to the point. 

10. Students argued with one another or with the instructor, not necessarily 
with hostility. 

11. The instructor complimented students on their work in front of others. 

12. He followed an outline closely. 

13. The students frequently volunteered their own opinions. 

14. He stimulated the intellectual curiosity of his students. 

15. In his class, I felt free to ask questions, to express my opinions and 
disagree. 

16. He maintained definite standard of student performance. 

28 
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17. He responded to hostility constructively. 

18. In his class students learned how to think more clearly about the area 
of this course. 

19. He was friendly. 

20. He continually emphasized grades. 

21. His course was well organized. 

22. He asked more than students could get done. 

25. He was tolerant of student opinions. 

2b, He let students know when they were wrong. 

25. He had everything going according to schedule. 

26. He stressed high quality work. 

27. He helped students learn from their mistakes. 

28. He was fair in grading and evaluation. 

29. He increased the interest of class members in his class. 

30. He criticized poor work. 

31. He appeared sensitive to students' feelings and problems. 

32. He discussed test material after each quiz or exam. 

33. He was permissive and flexible. 

jb, The content of examinations was appropriate. 

35. He kept students well informed of their progress. 

3 6. He made it clear to students about the purpose and objective of his 
course, and his expectation of students. 

37. In his class, students learned how to read materials in this area more 
effectively. 

For each of the following two items, select the one descriptive phrase 
which best represents your over-all opinion. 

29 
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38. How would you rate your instructor in general (all-around) teaching 
ability? 



a. an outstanding and stimulating instructor 

b. a very good instructor 

c. a good instructor 

d. an adequate, but not stimulating instructor 

e. a poor and inadequate instructor. 

39. How would you rate the over-all value of this course? 



a. superior 

b. very good 

c. good 

d. fair 

e. poor. 



Please list on the back of the answer sheet, the other courses (and 
section numbers) you are taking this term. 



Also make any comments that you may have on the back of the answer sheet. 
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Student Opinion Questionnaire 
( Post, test) 



Directions 



This is a research study aimed at the improvement of college 'eaching. 
The form attached is to be turned in to your psychology section instructor 
at the beginning of the next class period. 

Our previous studies have shown that students can adequately describe 
teaching behavior. Therefore, you are asked to spend a few minutes to help 
us better understand college teaching. 

Descriptions of teaching behavior could be based on (a) your actual 
observation of teacher in the classroom, or ( b) your expectation and past 
experience with teachers. Either perception or expectation would enable you 
to have some ideas about teacher’s role and his behavior. The purpose of 
this study is to find out what you expect your psychology teacher to be like. 

The questions which follow ask you to describe your section instructor’s 
behavior. Except for the last two items, they do not judge whether the 
behavior is desirable or undesirable. Therefore, in no way are the questions 
to be considered as a test” of your ability to answer the items or of the 
quality of the instructor’s behavior. 

Please make no mark in this booklet but record your answers on the 
separate answer sheet. At the top of the answer sheet fill in the blanks 
for sex, date, school, instructor’s name (if known), section number, and your 
ID number • The use of this questionnaire is for research purposes only. 

Your instructor will not see it, but we will return to him a statistical 
summary of the results after the semester is over. 

Now you are to describe your Introductory Psychology ( Psychology 170) 
Instructor . Read each item carefully. Think about how frequently the 
behavior described by the item occurs in your class. 
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Student Opinion Questionnaire 



Mark your answer to each item on the separate answer sheet in accordance with 
the following scales: 

a. This almost always occurs. 

b. This often occurs. 

c. This occasionally occurs. 

d. This seldom occurs. 

e. This never occurs. 

1. The students in the class were friendly. 

2. The instructor was skillful in observing student reactions. 

3. The instructor assigned very difficult readings. 

U, The in structor put his material across in an interesting way • 

5. He listened attentively to what class members had to say. 

6. In his class students gained a great deal of knowledge about this subject 
matter. 

7. He told students when they had done a particularly good Job. 

8. He decided in detail what should be done and how it should be done. 

9. He explained clearly and his explanations were to the point. 

10. Students argued with one another or with the instructor, not necessarily 
with hostility. 

11. The instructor complimented students on their work in front of others. 

12. He followed an outline closely. 

13. The students frequently volunteered their own opinions. 

1^. He stimulated the intellectual curiosity of his students. 

15. In his class, I felt free to ask questions, to express my opinions and 
disagree. 

1 6 . He maintained definite standard of student performance. 
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17 . 

18. 

19 . 

20 . 
21 . 
22 . 

23 . 

24 . 

25 . 

26. 

27 . 

28 . 

29 . 

30 . 

31 . 

32 . 

33 . 

34 . 

35 . 

36 . 

57 . 



He responded to hostility constructively. 

In his class students learned how to think more clearly about the area of 
this course. 

He was friendly. 

He continually emphasized grades. 

His course was well organized. 

He asked more than students could get done. 

He was tolerant of student opinions. 

He let students know when they were wrong. 

He had everything going according to schedule. 

He stressed high quality work. 

He helped students learn from their mistakes. 

He was fair in grading and evaluation. 

He increased the interest of class members in his class. 

He critici^cl poor work. 

He appeared sensitive to students’ feelings and problems. 

He discussed test material after each quiz or exam. 

He was permissive and flexible. 

The content of examinations was appropriate. 

He kept students well informed of their progress. 

He made it clear to students about the purpose and objective of his 
course, and his expectation of students. 

In his class, students learned how to read materials in this area more 
effectively. 

For each f the following two items, select the one descriptive phrase 



which best re esents your over-all opinion. 
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How would you rate your instructor in general (all-around) teaching 
ability? 



a. an outstanding and stimulating instructor 

b. a very good instructor 

c. a good instructor 

d. an adequate, but not stimulating instructor 

e. a poor and inadequate instructor. 

59 » How would you rate the over-all value of this course? 



a. superior 

b. very good 

c . good 

d. fair 

e . poor • 

Please list on the back of the answer sheet, the other courses (and 
section numbers) you are taking this term. 



Also make any comments that you may have on the back of the answer sheet. 
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APPENDIX B 

VARIMAX ROTATED FACTOR MATRICES FROM WHICH 
TABLES I THROUGH IV WERE DERIVED 
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Varimax Rotated Factor Matrix of 18 Teaching Fellows Multiple Discriminant 
Analysis Factors of Student Ratings (1971 data) 

(For Table i) 



Item 



1. Students were friendly. 

2. Skillful in observing studerts. 

3* Assigned difficult readings. 

4. Putting material in interesting 
way. 

5. Listened attentively to students. 

6. Students gained a great deal of 
knowledge. 

7. Told students about their particu- 
larly good doing. 

8. Decided in detail what should be 
done. 

9. Explained clearly. 

10. Students argued with one another 
or with instructor. 

11. Complimented students on their 
work. 

12. Followed an outline closely. 

13. Students frequently volunteered 
their opinions. 

14. Stimulated intellectual curiosity 
of students. 

15. Students felt free to ask ques- 
tions. 

16. Maintained definite standards. 

17* Responded to hostility construc- 
tively. 

18. Students learned to think more 
clearly. 

19* Instructor was friendly. 

20. Continually emphasized grades. 

21. Course was well organized. 

22. Asked more than students could get 
done. 

23« Tolerant of student opinions. 

24. Let students know when they were 
wrong. 

23. Had everything going according to 
schedule. 

26. Stressed high quality work. 



Factor 



I 


II 


III 


IV 


V 


•33 


.02 


•43 


.08 


.31 


• 43 


.14 


• 33 


• 07 


.01 


.16 


-37 


.20 


.40 


.16 


.40 


.22 


•13 


.14 


-.03 


.46 


.03 


•32 


.04 


-.03 


•34 


.23 


-.02 


• 03 


.22 


• 27 


.02 


.24 


-17 


•03 


• 18 


•39 


-07 


-.02 


.28 


.46 


•30 


.08 


.16 


.06 


• 07 


-.01 


.64 


.13 


-.10 


• 07 


.03 


•29 


-.01 


•03 


-.12 


.63 


.11 


-.02 


•09 


• 34 


.03 


.67 


.04 


-.03 


•37 


.03 


.22 


•03 


.01 


.42 


-.03 


•31 


-.09 


-.02 


.00 


.06 


-.06 


-.03 


.26 


•13 


-.03 


.10 


-.03 


-.13 


•43 


.32 


.11 


-.03 


.14 


.46 


-.09 


•23 


.24 


.04 


-.03 


.02 


.01 


•09 


.42 


•36 


•73 


.00 


.10 


.17 


.03 


-.08 


.10 


-.01 


.12 


• 43 


-.09 


.33 


.10 


-.24 


.12 


•13 


.02 


.26 


•29 


.21 


•39 


-.03 


.11 


.11 


.02 


•13 


• 07 


-.03 


•30 
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Varimox Rotated Factor Matrix of 18 Teaching Fellows Multiple Discriminant 
Analysis Factors of Student Ratings ( L'/fl- data) 

(For Table I, concluded) 



Item 



27. Helped students learn from their 
mistakes. 

28* Fairness in grading and evalua- 
tion. 

29. Increased the interest of stu- 
dents. 

30. Criticized poor work. 

51. Sensitive to students' feelings. 

52. Discussed test material after 
quiz. 

33. Was permissive and flexible. 

34. Appropriateness of examination. 

59. Kept students well informed. 

56. Made it clear to students about 

purposes, objective, and expecta- 
tion of his course. 

57* Students learned to read more ef- 
fectively. 

58. General teaching ability. 

59. Overall value of course. 



Factor 



I 


II 


III 


IV 


V 


.16 


•15 


.09 


-.06 


.06 


.27 


.04 


-.07 


-.16 


-.10 


.56 


.04 


.17 


.05 


.09 


-.03 


.02 


.02 


-.55 


.11 


.44 


1 

• 

0 

V* 


.26 


-.14 


-.12 


-.04 


.23 


.07 


.67 


•03 


.25 


-.22 


.28 


-.12 


-.23 


.51 


.20 


-.17 


-.16 


.12 


• 07 


.08 


.05 


-.26 


•5 7 



.20 


.22 


-.02 


-.16 


.15 


.17 


.16 


.19 


-.14 


.04 


.66 


.19 


.16 


.10 


-.06 


07 


.09 


.12 


.02 


.06 
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Varimax Rotated Factor Matrix of 13 Male Teaching Fellows Multiple 
Discriminant Analysis Factors of Student Ratings (1971 data) 

(For Table II) 



Item 

1. (l)* Students were friendly. 

2. (2) Skillful in observing students. 

3* (3) Assigned difficult readings. 

4. (4) Putting material in interesting way. 

3. (3) Listened attentively to students. 

6. ( 7 ) Told students about their particularly 
good doing. 

7* (8) Decided in detail what should be done. 
8. (9) Explained clearly. 

9« (10) Students argued with one another or 
with instructor. 

10. (11) Complimented students on their work. 

11. (12) Followed an outline closely. 

12. (13) Students frequently volunteered their 

opinions. 

13* (14) Stimulated intellectual curiosity of 
students. 

14.(13) Students felt free to ask questions. 

13* (16) Maintained definite standards. 

16.(19) Instructor was friendly. 

17* (20) Continually emphasized grades. 

18.(22) Asked more than students could get 
done. 

19* (23) Had everything going accordirg to 
schedule. 

20. (29) Increased the interest of students. 

21. (30) Criticized poor work. 

22. (33) Was permissive and flexible:. 

23* (38) General teaching ability. 

24.(39) Overall value of course. 



Factor 



I 


II 


III 


IV 


.28 


.13 


• 37 


•37 


.31 


.00 


.19 


.07 


-.03 


-.13 


-.03 


•77 


.32 


.12 


.03 


.06 


.43 


-.20 


.21 


.11 


.36 


-.03 


.14 


-.06 


.21 


•37 


-.03 


-.02 


.61 


.36 


.06 


.03 


. 16 


-.23 


.64 


.18 


.03 


.08 


.40 


.06 


.07 


.34 


.27 


-.30 


.43 


-.22 


.32 


.11 


.61 


-.07 


.00 


.05 


.41 


-.18 


. 16 


.04 


-.03 


.31 


-.02 


.02 


.40 


-.11 


.07 


.41 


-.16 


.31 


.23 


•33 


.06 


.04 


.09 


.20 


.40 


.50 


-.06 


-.13 


• 37 


.03 


.02 


.10 


-.05 


.12 


.24 


-.18 


.23 


-.41 


.30 


.03 


.78 


.01 


-.01 


.04 


.44 


.10 


,02 


.03 



Opinion Questionnaire in Appendix A. 




/ 
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Varlmax Rotated Factor Matrix of 13 Male Teaching Fellows Multiple 
Discriminant Analysis, Factors of Student Ratings (1961 data) 

(For Table III) 



Factor 





Item 


I 


II 


III 


IV 


1.(38)* 


General teaching ability. 


*74 


.00 


-.01 


.29 


2.(39) 


Overall value of course. 


•25 


.12 


.03 


.10 


3- (1) 


Students were friendly. 


.11 


.11 


.11 


.04 


1*. (2) 


Skillful in observing students. 


.62 


.10 


-.02 


.19 


5.(16) 


Maintained definite standards. 


*39 


.07 


.11 


-.06 


6.(15) 


Students felt free to ask questions. 


.08 


.03 


-.08 


.21 


7. (3) 

8. (10) 


Assigned difficult readings. 
Students argued with one another or 


-.01 


.78 


-.03 


.20 




with instructor. 


.14 


-.05 


-.05 


-.02 


9- (8) 


Decided in detail what should be done. 


*25 


-.05 


;2i 


.06 


10. (5) 


Listened attentively to students. 


*15 


-.04 


.02 


.34 


11. (4) 


Putting material in interesting way. 


*74 


-.11 


. 06 


.48 


12.(19) 


Instructor was friendly. 


.22 


-.19 


-.18 


.32 


15.(12) 


Followed an outline closely. 


-.17 


-.09 


.80 


.13 


14. (29) 

15. (22) 


Increased the interest of students. 
Asked more than students could get 


.46 


-.13 


.20 


.40 


16. (7) 


done. 

Told students about their particularly 


.09 


*54 


-.03 


-.14 




good doing. 


-.17 


.12 


-.00 


• 39 


17.(20) 


Continually emphasized grades. 


-.10 


-.06 


-.11 


-.40 


18. (33) 

19. (25) 


Was permissive and flexible. 

Had everything going according to 


.19 


-.10 


-.16 


.21 


20.(13) 


schedule. 

Students frequently volunteered their 


.29 


.12 


.72 


-.13 




opinions. 


*35 


.07 


.03 


-.03 


21.(11) 

22.(14) 


Complimented students on their work. 
Stimulated intellectual curiosity of 


• 33 


.01 


-.01 


.41 




students. 


.60 


.03 


.01 


.29 


23. (30) 


Criticized poor work. 


-.03 


.15 


-.20 


•13 


24. (9) 


Explained clearly. 


.67 


-.02 


.04 


.28 


*The number in parentheses corresponds to the item 
Opinion Questionnaire in Appendix A. 


number 


of the 


Student 
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Varimax Rotated Factor Matrix of 18 Teaching Fellows Self-Ratings 
on Teaching Behavior (Psychology 170, Winter, 1971) 





(For Table IV) 




Factor 








lueia 


I 


II 


III 


IV 


V 


1. 


Students were friendly. 


.22 


-.14 


-.01 


.07 


.70 


2. 


Skillful in observing students. 


•32 


.02 


.41 


.11 


.14 


3- 


Assigned difficult readings. 


.11 


.03 


.28 


.80 


.23 


4. 


Putting material in interesting 
way. 


.44 


•31 


-.30 


.30 


-.22 


3- 


Listened attentively to students. 


-.13 


.04 


.36 


.07 


-.07 


6. 


Students gained a great deal of 
knowledge. 


-.11 


• 63 


-. 26 


.23 


.34 


7. 


Told students about their particu- 
larly good doing. 


• 03 


-.16 


.21 


.16 


• 74 


8* 


Decided in detail what should be 
done. 


-.02 


-.08 


-.46 


.26 


.49 


9* 


Explained clearly. 


•79 


-.03 


.03 


-.06 


.12 


10. 


Students argued with one another 
or with instructor. 


.01 


.43 


-.17 


.47 


.41 


11. 


Complimented students on their 
work. 


-.48 


-.02 


.16 


.22 


• 38 


12. 


Followed an outline closely. 


-•39 


-.03 


-.36 


-.28 


.47 


13. 


Students frequently volunteered 
their opinions. 


.68 


.11 


.00 


-.07 


.12 


14. 


Stimulated ■' v vtellectual curiosity 
of students. 


•78 


.28 


-.03 


.24 


-.04 


13. 


Students felt free to ask ques- 
tions. 


-.03 


•33 


-.09 


-.23 


.62 


16 . 


Maintained definite standards. 


-.16 


.20 


.31 


.04 


•73 


17. 


Responded to hostility construc- 
tively. 


• 37 


.06 


.08 


-.32 


-.16 


00 

• 


Students learned to think more 
clearly. 


•72 


-.14 


•35 


-.13 


.27 


19. 


Instructor was friendly. 


.12 


• 34 


.12 


.43 


-.26 


20. 


Continually emphasized grades. 


• 31 


-.07 


-.41 


.44 


.66 


21. 


Course was well organized. 


• 23 


.41 


-.30 


-.63 


.27 


22. 


Asked more than students could get 
done. 


-.07 


-.21 


- • 16 


.34 


.48 


23. 


Tolerant of student opinions. 


• 37 


-.06 


.44 


.03 


.02 


24. 


Let students know when they were 
wrong. 


.01 


-.02 


.74 


.40 


.19 


23. 


Had everything going according to 
schedule. 


-.23 


-. LI. 


- . (,(j 


. 1 1 


• W 


26 . 


Stressed high quality work. 


• 13 


.30 


.29 


.09 


• 33 
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Varimax Rotated Factor Matrix of 18 Teaching Fellows Self-Ratings 
on Teaching Behavior (Psychology 170, Winter, 1971) 

(For Table IV, concluded) 



Factor 





Item 


I 


II 


III 


IV 


V 


27- 


Helped students learn from their 
mistakes. 


.46 


1 

• 

OO 


.69 


.54 


.19 


28. 


Fairness in grading and evalua- 
tion. 


.01 


.84 


• 

OO 


-.15 


0 

OJ 

• 


29 . 


Increased the interest of stu- 
dents. 


.65 


• 54 


-.08 


-.28 


-.02 


50 . 


Criticized poor work. 


- . 48 


• 25 


-.28 


•56 


.50 


51 . 


Sensitive to students’ feelings. 


.26 


-.21 


.18 


-.66 


-.20 


52 . 


Discussed test material after 
quiz. 


OJ 

H 

• 


.05 


.78 


-.08 


.02 


55 . 


Was permissive and flexible. 


1 — 1 

OJ 

• 


.10 


.61 


-.19 


.04 


54 . 


Appropriateness of examination. 


-.01 


•75 


• 51 


.01 


-.22 


55 . 


Kept students well informed. 


-55 


.17 


-.20 


.04 


.21 


56 . 


Made it clear to students about 
purposes, objective, and expecta- 
tion of his course. 


•19 


.01 


1 

• 

ro 


O 

OJ 

• 

I 


•70 


57 . 


Students learned to read more ef- 
fectively. 


.69 


.18 


. 16 


-.45 


•25 


58. 


General teaching ability. 


.69 


.41 


1 

• 

O 


.08 


-.18 


59- 


Overall value of course. 


.24 


.69 


.07 


.10 


-.15 




59 



